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in rfecent years; psychology, among other disciplines*, has shown increasing 
' * * * •* * 

interest in issues concerning the perception- of wcxneri. One area of research 

dealing with this concern has been the investigation of \peyceived ferrujune- 

professional competence, Specifically, researchers (i.e^, Cbobot, Goldberg, . 

Abramsbn & Abramson, 1974; Goldberg, 1968; Levenson, Burford, Bonno, & Davis, 

1975; Mischel, 1974; Pahek,-Deitchman, Wkhdlder, &' Greenawalt, 1976a; Panek, 

i 

Deitchman, Burkholder, Speroff,, &, Haude, 1976b) have examined the effect of 
arj author's sex on subject's evaluations of written material. This procedure 
involves the submission of articles^frcm various professional fields, contained 
in booklets, to subjects for evaluation. As seen in Table 1, the articles are 

Insert Table 1 Abfut Here 

. ............. ] . 

from fields of differential association, (i.e. , traditionally male, and 
traditionally neutral) , which are identical te^en the booklets. . The experi- 
mental manipualtion involves the sex of the $resume4 author of the article. , 
•This is accomplished by changing the author's name,J^ha^ls, in one set of 
booklets the author is portrayed -as a female, while Mi the other set of book- 
lets the identical article, has. the name of a male iuthor. The dependent . 
measure used in this type of .research are the evaluation scores, based on the 
questions which follow each article on,which subjects' ratetiae^ author and the 
article.' These questions are identical for all art&e3£SL&nd subjects.' "Bias" 
in evaluation is thought to occur or have been demonstrated when the mean 

.uation scores given to a' particular article are significantly different 
wherv the presg^ author ^designated as a male or female. 

Goldberg (1968) , 'using this procedure, found female college students 
evaluated the articles allegedly written by males more positively than the 
^identical^ articles attributed to a female .author. Results indicated ithe work 
of females was not only devalued in the field's traditionally associated with 
males (city planning, and law) and fields of neutral association (art history 



and linguistics) but also in fields^ traditionally associated with women # ' ^ 

{die'tetics*and elementary eduption) • _ Since 1968 , numerous investigations . 

using the Goldberg procedure, have failed to replicate his filings (c.f . , 

Baruch f I9J2; Chobot et a\. , 1974; Levenson et al.> 1975; Mischel, 1974^^ ^ * 

Faneket.al.., i976a; Panek et'al., 1976b). Hie implications, of- course, is 

that women are not perceive^ as carpetent as males > regardless of the fie3jfc 

or occupation the women represents. * The. f ailure to replicate the findings 

* . 

of Goldberg (1968) has been attributed^ to factors such as, a change in. / 

society's view of feminine work due to^the inpact: of the feminist movement,* 

differences in the subjects .used, differenced in the articles used, or to a 

possible interaction of two or more of these factors. Aside from the con- 

flicting results obtained vising this procedure, (which possibiy may 'be ex- 

plained by the methodological difficulties just mentioned) ; potentially, \ 

there is an additional methodological* problem, 

-Researchers using the Goldberg procedure interpret their results on ^ - 

the foundation or belief that subject ' Sybase their evaluations solely on the 

basis, of the sex of the presumed author; or alternatively, on' the basis of 

a cognitive interaction between the author's sex and' the tradiOsnal sex . 4 ' 

association -of the^srofessional ffeld. This interpretation overlooxs two 

important issues which 'have critical 'iiiportance for this type of research. 

First, it may be questionned whether the sex association of the ^professional 

•.fields have remained constant over time. That is, have^the traditional- <sex , 

associations of the various fields* changed "as a result of. social awareness 

or seme other factor .'since 1968, when Goldberg' first developed his procedure. 

This point has been considered elsewhere by, Panek, Rusjj and Greenawalt (1977). # 
o : ,-/-•„-., - ' v ■ -* ' 

Secondly /the Goldberg ,methodology 'overlooks the fact that there may 

be qualitative differences 'between the articles on dimensions such as, reading 

ease, writing style, and reading grade le^el required of the subjects for \ 

" understanding the material. These qualitative differences between articles 

could possibly have a significant affect on subjects " evaluations and perception 

of 'the Articles. " ._• • * * 



As a simplified example, . imagine that subjects hold a stereotype which 

§ • 

specifies that males -are better educated and hence write more taonplicated 

material; *and that females are less educated and hence complicated material 

reflects their, professional ingompetence or inability to express themselves; , 

this, of course, depends - on the subjects 1 reading, ability, : what is#ccm- • 

plicated for sane, is easy for otherfe. Assuming that a subject held such 

a stereotype, it might be expected that a female author of complicated 

written material would be devalued. Thus the results obtained using this 

• f * 

procedure may vary with the reading abilities of the subjects used. 

Quantitative differences in the Goldberg articles would suggest a cat*- 
plex confounding of evaluations which would render the interpretation of 
results obtained using this procedure problematic at best. *The purpose of 

the present study was to investigate- this issue. That is, to examine the 

. * * 

- readability of the articles used by Goldberg and others,, to determine whether 
' they .are equivalent in reading ease, writing style and required reading'grade 
level. , " .* 

— ; • 

/ . 1 Method ■ , / 

Materials / . . - 

' There were six' articles, one from each of the following professional 

fields:' '.art history, , city planning, elementary education, linguistics, law, 

\ * - * 

dietetics. These articles wpre those used by' Goldberg (1968)' and Panek, 

et al. (1976, a, b). 
Procedure 

- to test trie equivalence of the six Goldberg (1968) articles with re- 
gard tcTthe properties of ^reading ease, grad6 level, and writing stiyle, 
< three different teadability^in^exes were applied to/ each of the articles. 

\ : ^ , \ k . ■ r . : f 

These indexes were the Dale-K^V (1948) , the Flench (1948) , and the SMOG 
' (Mclaughlin, 1969X? As Ash and Edgell (1976) have noted, the factors 
typically stressed- in evaluating readability include: 1) the camDnhess 



of v£>rds (whether the words used in the itext appear on a list of familiar j 
rard&f; ,2) word length (huniber of letters -or syllables); and 3) sentence 

length. . N , 1 • \ ^ K . ' 

The pale-Chall ,index-is based on~Both the *a±nonnesk of words and tte 
length of sentences in the read ing 'material , to derive a raw x score ranging 

from CLto 10+ which correspond to grade levels required, for- understanding \ 

* ' ' . *. ^ * * * . • 

the material • The.Flesch index carbines a measure dE vrord length ana x 
sentence length to derive a score of reading ease. This score places the 
material* on a scale *d±h a range, between 0 '(practically unreadable! to , 
100 (easy for any literate ' person) ' In addition, at ^Sica^ scale intervals 

'are descriptions of writing style which correspond with the numerical sc6re 

* ' * * ' \ 

for reading ease. * These range f rod very difficult to very easy (see Flesch, 

4 194B) , • ' * . ' , h 

r ' I ' - 4l 

The StCC? index (McLaughlin, 1969) is based on the total* number of 
words of three or nore syllables either in the entire te$>or a selected / 

1 sample of that text. 'Applying the SMOG readability formula to the material 

. . Q ■ 

(see McLaughlin, 1969) gives the SMOG grade, which ds considered the reading 
grade a person must have attained if he or she is to understand the material. 

' ' • ■ ' ■ • ' : . • ■ A '■ 

■Results \ ... 

- When the Dale-Chall (Dale & Chall, 1948), SMOG (McLaughlin, 1969), " 
and the Efcesch (19*48) readability indexes were applied to the six Goldberg 
(1968) articles, the articles differed in grade level reading ease, and 



Insert Table 2 About Here 



writing style, as 'can be observed in Table 2. Using t the Dale-Chall method, 

* • * * * 1 ' , 

the grade, levels required for understanding the articles, ranged from a 
low' of 9 to 10 (linguistic^ ^and dietetics), to a high of 16> (Law)- With ^ 
SMOG index, the grade. levels, ranged from a low of 11 .(dietetics) tto a 
high of 19+ (law). Concerning writing"style, three articles were found to , 



be difficult (art 1 history/ elementary ^education arid law) and ttiree" were' " 
found to be fairly difficult (city planning/ linguistics, and dietetics). 
Although fihese three methods yielded saitewhat different results in «one 
cases, 'the conclusion ronains unaltered. The Goldberg articles are not' 
equivalent with regard to any pf 'the readability criteria investigated. 

That is, the. articles differ in reading ease, writing style, and grade 

f 

levefer ' 4 * — * 

Discussion - 

On the basis of these "findings^ it~would .appear that of the six ^articles,, 
'' only three (i.e., art history, city planning, and elenehtary education) apy - 
pear to be appropriate for sample composed of college" freshman and sophomores— 
the sanjgtfes typically used in research utilizing the Goldberg procedure. 
These articles are thought to be appropriate, since the required reading 
level is' expected ( to be conmensur ate with the average reading ability of the 
typical sample. • * 

Assuming that Qualitative differences between the articles in readability 
affects subjects 1 evaluations and perceptions of the ctrticles in an unknown* 
manner, it i$ reccumended that researchers utilizing the Goldberg procedure 
equate the articles on readability, and in addition, establish a congruence 

» » » . 

between the' articles 1 required reading level -and the subjects 1 reading a 
ability. tfnless these precautions are acxxxnplished, the interpretation of 
results basemen this procedure using the 6 articles may_be uninterpretable 
or at best problematic. 1 Without controlling for the factors of reading 

IN / * 

ease, writing style, and grade level, future studies of f, sex bias" may. 
result in the same type of conflicting\resiiLts as reported in past literature. 

The problem of qualitative .differences itl .readability,., and a -congruence . ' 
between required reading level 4 and the samples \ reading ability is not 
germane to only the Goldberg procedure. TheseH:actors~w3uld seen /to also ^ 
warrant consideration in other a£6as of research investigating sj/stematic - 



bias and stfereotypes; sudh as, Rdsen and Jordee 1 ^ "(1974)^ research prix&iwce 

* ** -* 1 = ***** * 

utilizing job resumes in investigating covert sex discrimination; 

* Vfe feel that establishment of reading equivalence both v in terms of- the 

• * -* 

stimulus used, and between the stimuli and the subjects 1 ability should be 
adopted in 'future research in this area. > t « 
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Booklet 


Field 


of the Field 


Author 





B- 



Art History 
City Planning 
Elementary Education 
Law - ' i 

Linguistics 
Dietetics 
Art History 
City Planning V 0 

^Elementary Education 

> — - 

Law . " 

Linguistics 

Dietetics 



Neutral 
Male 
Femal^ # 
Male_ I 
N^ujbr4k 
Female 
Neutral 
^Mal'e 
Female 
Male ■ 
Neutral 
Femal^ 



Joseph ft. Banks 
' Harriet fV Redlich 
Pauline L. Qonger 
/Louis, $i Mp%aru 
Joan T. McK^tV 
Stephen E. Hamilton 
Ju^ie W/ Banks 
Harry F. R^llich » 
> Paul L. Conger 
• Lydia M. Morgan m . 
John T. McKay 
Stella v E. Hamilton 
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< ■ . Table 2 



* • Readability of Each Article by Ea^elx-Method* 



'Method of Determination of Rejadafoility 



Dale-Chall 



Flesch 





Paw 


* Grade- 


Article 


Score « 


Leve 1 • 


> 

Art . 

• 

^HistoryL • 




11-12 • 

* 


City 

Planning * 


8.38 


j 

* 41-12 


Elementary 
Education 


8.07 


11-12 


Law 


10,04 


16 


Linguistics 


7.19 


9-10 


Dietetics 
> 


7.8"2 


9-10 
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— * — — — 





Reading 
Ease* 



44.87 



50.15 



/• 




■i'L 



. SMOG 



Grade 
Level 



4^ 36 



55.44 

50^22 



\ 



Dix£icult 



Fairly - 
Difficult 



Difficult 

Difficult 

Fairly 
'Difficult 

Fairly 
Difficult 



13+ 



/ 0 



t, \ 



\ ■ 



-J O ;• 



10 
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